Test Data Raw Summary

Dataset statistics

Number of variables	33
Number of observations	2080
Missing cells	11772
Missing cells (%)	17.2%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	536.4 KiB
Average record size in memory	264.1 B

Variable types

CAT	22
NUM	10
UNSUPPORTED	1

Reproduction

Analysis started	2020-06-27 02:28:53.843135
Analysis finished	2020-06-27 02:29:10.150339
Duration	16.31 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`atty_firm_name` has a high cardinality: 195 distinct values	High cardinality
`detail_cause` has a high cardinality: 56 distinct values	High cardinality
`how_injury_occur` has a high cardinality: 2077 distinct values	High cardinality
`injury_city` has a high cardinality: 392 distinct values	High cardinality
`injury_postal` has a high cardinality: 550 distinct values	High cardinality
`detail_cause` is highly correlated with `cause`	High correlation
`cause` is highly correlated with `detail_cause`	High correlation
`osha_injury_type` is highly correlated with `nature_injury`	High correlation
`nature_injury` is highly correlated with `osha_injury_type` and 1 other fields	High correlation
`type_loss` is highly correlated with `nature_injury`	High correlation
`Dependent` has 2080 (100.0%) missing values	Missing
`ave_wkly_wage` has 1304 (62.7%) missing values	Missing
`claimant_age` has 308 (14.8%) missing values	Missing
`atty_firm_name` has 1695 (81.5%) missing values	Missing
`marital_status` has 1742 (83.8%) missing values	Missing
`depart_code` has 1095 (52.6%) missing values	Missing
`injury_postal` has 513 (24.7%) missing values	Missing
`#dependents` has 2016 (96.9%) missing values	Missing
`severity_index` has 41 (2.0%) missing values	Missing
`reforms_dummy` has 837 (40.2%) missing values	Missing
`length_employed` has 109 (5.2%) missing values	Missing
`how_injury_occur` is uniformly distributed	Uniform
`Dependent` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`time_injury` has 368 (17.7%) zeros	Zeros
`diff_carrier_employer` has 473 (22.7%) zeros	Zeros
`diff_employer_injury` has 1506 (72.4%) zeros	Zeros

Dependent
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	2080
Missing (%)	100.0%
Memory size	16.4 KiB

ave_wkly_wage
Real number (ℝ_≥0)

MISSING

Distinct count	464
Unique (%)	59.8%
Missing	1304
Missing (%)	62.7%
Infinite	0
Infinite (%)	0.0%

Mean	1138.7731958762886
Minimum	2.0
Maximum	9000.0
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	2
5-th percentile	150
Q1	500
median	960
Q3	1503.5
95-th percentile	2624.25
Maximum	9000
Range	8998
Interquartile range (IQR)	1003.5

Descriptive statistics

Standard deviation	995.9269763
Coefficient of variation (CV)	0.8745613085
Kurtosis	14.52735374
Mean	1138.773196
Median Absolute Deviation (MAD)	498.5
Skewness	2.94457534
Sum	883688
Variance	991870.542

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
500	47	2.3%
1000	29	1.4%
320	25	1.2%
600	21	1.0%
150	20	1.0%
1500	16	0.8%
100	16	0.8%
400	16	0.8%
800	10	0.5%
300	9	0.4%
Other values (454)	567	27.3%
(Missing)	1304	62.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	2	0.1%
6	1	< 0.1%
10	1	< 0.1%
16	1	< 0.1%
19	1	< 0.1%

Value	Count	Frequency (%)
9000	1	< 0.1%
8304	1	< 0.1%
7181	1	< 0.1%
7142	1	< 0.1%
6000	2	0.1%

body_part
Categorical

Distinct count	44
Unique (%)	2.1%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Finger(s)	173
Knee	168
Low Back Area	162
Other Facial Soft Tissue	158
Ankle	142
Other values (39)	1277

Common Values
Length

Value	Count	Frequency (%)
Finger(s)	173	8.3%
Knee	168	8.1%
Low Back Area	162	7.8%
Other Facial Soft Tissue	158	7.6%
Ankle	142	6.8%
Eye(s)	136	6.5%
Hand	118	5.7%
Lower Leg	87	4.2%
Shoulder(s)	84	4.0%
Wrist	79	3.8%
Other values (34)	773	37.2%

Length

Max length	54
Median length	6
Mean length	10.40673077
Min length	3

cause
Categorical

HIGH CORRELATION

Distinct count	10
Unique (%)	0.5%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Strain or Injury By	553
Fall, Slip or Trip Injury	368
Struck or Injured By	343
Cut, Puncture, Scrape Injured By	255
Miscellaneous Causes	251
Other values (5)	310

Common Values
Length

Value	Count	Frequency (%)
Strain or Injury By	553	26.6%
Fall, Slip or Trip Injury	368	17.7%
Struck or Injured By	343	16.5%
Cut, Puncture, Scrape Injured By	255	12.3%
Miscellaneous Causes	251	12.1%
Striking Against or Stepping on	143	6.9%
Caught In, Under or Between	85	4.1%
Motor Vehicle	53	2.5%
Burn or Scald - Heat or Cold Exposure	28	1.3%
Rubbed or Abraded By	1	< 0.1%

Length

Max length	37
Median length	20
Mean length	23.18269231
Min length	13

claimant_age
Real number (ℝ_≥0)

MISSING

Distinct count	62
Unique (%)	3.5%
Missing	308
Missing (%)	14.8%
Infinite	0
Infinite (%)	0.0%

Mean	40.090857787810386
Minimum	1.0
Maximum	88.0
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	1
5-th percentile	22.55
Q1	30
median	40
Q3	49
95-th percentile	60
Maximum	88
Range	87
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	12.0022201
Coefficient of variation (CV)	0.2993754877
Kurtosis	-0.4956951031
Mean	40.09085779
Median Absolute Deviation (MAD)	9
Skewness	0.2236443653
Sum	71041
Variance	144.0532873

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
39	60	2.9%
41	57	2.7%
30	55	2.6%
46	53	2.5%
38	53	2.5%
42	53	2.5%
27	52	2.5%
40	52	2.5%
25	52	2.5%
26	50	2.4%
Other values (52)	1235	59.4%
(Missing)	308	14.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2	0.1%
10	2	0.1%
16	1	< 0.1%
17	4	0.2%
18	9	0.4%

Value	Count	Frequency (%)
88	1	< 0.1%
77	1	< 0.1%
74	2	0.1%
72	2	0.1%
71	2	0.1%

atty_firm_name
Categorical

HIGH CARDINALITY
MISSING

Distinct count	195
Unique (%)	50.6%
Missing	1695
Missing (%)	81.5%
Memory size	16.2 KiB

TLEVY, STERN & FORD	10
TJ. LEEDS BARROL, IV ATTORNEY AT LAW	8
TSHERMAN, FEDERMAN SAMBUR & LEVINE	7
TLEVY, FORD & WALLACH	6
TGORDON, EDELSTEIN, KREPACK, ET AL	6
Other values (190)	348

Common Values
Length

Value	Count	Frequency (%)
TLEVY, STERN & FORD	10	0.5%
TJ. LEEDS BARROL, IV ATTORNEY AT LAW	8	0.4%
TSHERMAN, FEDERMAN SAMBUR & LEVINE	7	0.3%
TLEVY, FORD & WALLACH	6	0.3%
TGORDON, EDELSTEIN, KREPACK, ET AL	6	0.3%
TLAW OFFICE OF CHRISTINE T. NELSON	6	0.3%
TSCHUMMER, ROLBIN, & HURST	6	0.3%
TTHE KLEIN LAW GROUP P.C.	5	0.2%
TRANIERI & NEWMAN	5	0.2%
TKUSION & CAMPANA	5	0.2%
Other values (185)	321	15.4%
(Missing)	1695	81.5%

Length

Max length	57
Median length	3
Mean length	7.348557692
Min length	3

gender
Categorical

Distinct count	3
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Male	1661
Female	411
Uknown	8

Common Values
Length

Value	Count	Frequency (%)
Male	1661	79.9%
Female	411	19.8%
Uknown	8	0.4%

Length

Max length	6
Median length	4
Mean length	4.402884615
Min length	4

marital_status
Categorical

MISSING

Distinct count	3
Unique (%)	0.9%
Missing	1742
Missing (%)	83.8%
Memory size	16.2 KiB

Unmarried, Single, Widowed, Divorced	187
Married	149
Separated	2

Common Values
Length

Value	Count	Frequency (%)
Unmarried, Single, Widowed, Divorced	187	9.0%
Married	149	7.2%
Separated	2	0.1%
(Missing)	1742	83.8%

Length

Max length	36
Median length	3
Mean length	6.259134615
Min length	3

claim_st
Categorical

Distinct count	44
Unique (%)	2.1%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

California	1186
New York	130
New Mexico	85
Georgia	80
North Carolina	79
Other values (39)	520

Common Values
Length

Value	Count	Frequency (%)
California	1186	57.0%
New York	130	6.2%
New Mexico	85	4.1%
Georgia	80	3.8%
North Carolina	79	3.8%
Texas	71	3.4%
Louisiana	62	3.0%
New Jersey	53	2.5%
Illinois	32	1.5%
Pennsylvania	25	1.2%
Other values (34)	277	13.3%

Length

Max length	15
Median length	10
Mean length	9.4625
Min length	4

depart_code
Real number (ℝ_≥0)

MISSING

Distinct count	21
Unique (%)	2.1%
Missing	1095
Missing (%)	52.6%
Infinite	0
Infinite (%)	0.0%

Mean	12.22741116751269
Minimum	1.0
Maximum	23.0
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	6
median	14
Q3	18
95-th percentile	21
Maximum	23
Range	22
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	6.880886977
Coefficient of variation (CV)	0.5627427493
Kurtosis	-1.438882831
Mean	12.22741117
Median Absolute Deviation (MAD)	6
Skewness	-0.1487988687
Sum	12044
Variance	47.34660559

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
21	156	7.5%
8	129	6.2%
17	128	6.2%
3	90	4.3%
6	74	3.6%
18	64	3.1%
2	62	3.0%
14	62	3.0%
11	59	2.8%
1	30	1.4%
Other values (11)	131	6.3%
(Missing)	1095	52.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	30	1.4%
2	62	3.0%
3	90	4.3%
4	11	0.5%
5	12	0.6%

Value	Count	Frequency (%)
23	5	0.2%
22	16	0.8%
21	156	7.5%
20	20	1.0%
19	21	1.0%

detail_cause
Categorical

HIGH CARDINALITY
HIGH CORRELATION

Distinct count	56
Unique (%)	2.7%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Strain/Injury by Misc	204
Strain/Injury by Lifting	151
Struck by Falling/Flying Object	130
Fall/Slip, Same Level	127
Misc, Foreign Body in Eye	114
Other values (51)	1354

Common Values
Length

Value	Count	Frequency (%)
Strain/Injury by Misc	204	9.8%
Strain/Injury by Lifting	151	7.3%
Struck by Falling/Flying Object	130	6.2%
Fall/Slip, Same Level	127	6.1%
Misc, Foreign Body in Eye	114	5.5%
Strike/Step On, Fixed Object	110	5.3%
Cut/Puncture/Scrape, Object Lift/Handled	108	5.2%
Misc, Other	104	5.0%
Fall/Slip, Misc	87	4.2%
Cut/Puncture/Scrape, Hand Tool	67	3.2%
Other values (46)	878	42.2%

Length

Max length	40
Median length	25
Mean length	25.66538462
Min length	9

domestic_foreign
Categorical

Distinct count	2
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Domestic	2061
Foreign	19

Common Values
Length

Value	Count	Frequency (%)
Domestic	2061	99.1%
Foreign	19	0.9%

Length

Max length	8
Median length	8
Mean length	7.990865385
Min length	7

employ_status
Categorical

Distinct count	8
Unique (%)	0.4%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Unknown/Other	1728
Full-Time	307
Seasonal	20
Part-Time	12
Piece Worker	7
Other values (3)	6

Common Values
Length

Value	Count	Frequency (%)
Unknown/Other	1728	83.1%
Full-Time	307	14.8%
Seasonal	20	1.0%
Part-Time	12	0.6%
Piece Worker	7	0.3%
On Strike	3	0.1%
Disabled	2	0.1%
Retired	1	< 0.1%

Length

Max length	13
Median length	13
Mean length	12.32163462
Min length	7

handling_office
Categorical

Distinct count	28
Unique (%)	1.3%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

LOS ANGELE	975
SACRAMENTO	263
DALLAS WC	177
NEW JERSEY	108
CHARLOTTE	78
Other values (23)	479

Common Values
Length

Value	Count	Frequency (%)
LOS ANGELE	975	46.9%
SACRAMENTO	263	12.6%
DALLAS WC	177	8.5%
NEW JERSEY	108	5.2%
CHARLOTTE	78	3.8%
LONG ISLAN	59	2.8%
IN-STATE A	57	2.7%
WC SOUTHEA	56	2.7%
ATLANTA	51	2.5%
ILLINOIS	42	2.0%
Other values (18)	214	10.3%

Length

Max length	10
Median length	10
Mean length	9.675961538
Min length	6

how_injury_occur
Categorical

HIGH CARDINALITY
UNIFORM

Distinct count	2077
Unique (%)	99.9%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

UNKNOWN	2
WHILE WORKING IN A WOODED - TALL GRASS AREA - EE WAS BITTEN	2
EMPLOYEE WAS WORKING ON SET WHEN HE SUSTAINED AN INSECT BITE	2
HE WAS WORKING ON HIS HANDS AND KNEES PUTTING LAYOUT PAPER D	1
TRYING TO MOVE EQUIPMENT ON THE TRUCK AND WAS STRUCK IN THE	1
Other values (2072)	2072

Common Values
Length

Value	Count	Frequency (%)
UNKNOWN	2	0.1%
WHILE WORKING IN A WOODED - TALL GRASS AREA - EE WAS BITTEN	2	0.1%
EMPLOYEE WAS WORKING ON SET WHEN HE SUSTAINED AN INSECT BITE	2	0.1%
HE WAS WORKING ON HIS HANDS AND KNEES PUTTING LAYOUT PAPER D	1	< 0.1%
TRYING TO MOVE EQUIPMENT ON THE TRUCK AND WAS STRUCK IN THE	1	< 0.1%
WHILE PULLING THE SAFETY TENSION LINE EE FELT A POP IN HIS R	1	< 0.1%
WHILE EMPLOYEE CARRYING EQUIPMENT ACROSS A DARK PARKING LOT	1	< 0.1%
EMPLOYEE WAS MOVING TOOL BOX FROM STAGE TO LOCK UP WHEN IT R	1	< 0.1%
WHILE EE ON SET LOCATION UNLOADING PROPERTY EQUIPMENT HE STR	1	< 0.1%
ON A RAINY DAY - EMPLOYEE WAS WALKING INTO A BUILDING (SET)	1	< 0.1%
Other values (2067)	2067	99.4%

Length

Max length	60
Median length	60
Mean length	57.67163462
Min length	7

injury_city
Categorical

HIGH CARDINALITY

Distinct count	392
Unique (%)	18.8%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

LOS ANGELES	308
BURBANK	215
UNKNOWN	207
NEW ORLEANS	97
NEW YORK	51
Other values (387)	1202

Common Values
Length

Value	Count	Frequency (%)
LOS ANGELES	308	14.8%
BURBANK	215	10.3%
UNKNOWN	207	10.0%
NEW ORLEANS	97	4.7%
NEW YORK	51	2.5%
BROOKLYN	48	2.3%
WILMINGTON	42	2.0%
CULVER CITY	38	1.8%
ATLANTA	28	1.3%
AUSTIN	27	1.3%
Other values (382)	1019	49.0%

Length

Max length	19
Median length	8
Mean length	9.078846154
Min length	2

injury_postal
Categorical

HIGH CARDINALITY
MISSING

Distinct count	550
Unique (%)	35.1%
Missing	513
Missing (%)	24.7%
Memory size	16.2 KiB

91502	194
95816	55
90038	38
91505	29
90028	26
Other values (545)	1225

Common Values
Length

Value	Count	Frequency (%)
91502	194	9.3%
95816	55	2.6%
90038	38	1.8%
91505	29	1.4%
90028	26	1.2%
91608	25	1.2%
90001	24	1.2%
91504	24	1.2%
90232	21	1.0%
90009	20	1.0%
Other values (540)	1111	53.4%
(Missing)	513	24.7%

Length

Max length	9
Median length	5
Mean length	4.495192308
Min length	3

injury_state
Categorical

Distinct count	37
Unique (%)	1.8%
Missing	1
Missing (%)	< 0.1%
Memory size	16.2 KiB

California	1092
Louisiana	174
New York	171
Georgia	93
North Carolina	75
Other values (32)	474

Common Values
Length

Value	Count	Frequency (%)
California	1092	52.5%
Louisiana	174	8.4%
New York	171	8.2%
Georgia	93	4.5%
North Carolina	75	3.6%
Texas	52	2.5%
Hawaii	48	2.3%
Michigan	43	2.1%
New Mexico	43	2.1%
Illinois	35	1.7%
Other values (27)	253	12.2%

Length

Max length	20
Median length	10
Mean length	9.455769231
Min length	3

jurisdiction
Categorical

Distinct count	34
Unique (%)	1.6%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

California	1243
New York	194
Louisiana	130
Georgia	81
North Carolina	77
Other values (29)	355

Common Values
Length

Value	Count	Frequency (%)
California	1243	59.8%
New York	194	9.3%
Louisiana	130	6.2%
Georgia	81	3.9%
North Carolina	77	3.7%
Texas	42	2.0%
Illinois	37	1.8%
New Mexico	34	1.6%
Hawaii	32	1.5%
Pennsylvania	31	1.5%
Other values (24)	179	8.6%

Length

Max length	20
Median length	10
Mean length	9.515384615
Min length	4

lost_time_or_medicalonly
Categorical

Distinct count	2
Unique (%)	0.1%
Missing	1
Missing (%)	< 0.1%
Memory size	16.2 KiB

Medical Only	1581
Lost Time	498

Common Values
Length

Value	Count	Frequency (%)
Medical Only	1581	76.0%
Lost Time	498	23.9%
(Missing)	1	< 0.1%

Length

Max length	12
Median length	12
Mean length	11.27740385
Min length	3

nature_injury
Categorical

HIGH CORRELATION

Distinct count	36
Unique (%)	1.7%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Strain	477
Laceration	341
Specific Injury - All Other	309
Contusion	234
Sprain	144
Other values (31)	575

Common Values
Length

Value	Count	Frequency (%)
Strain	477	22.9%
Laceration	341	16.4%
Specific Injury - All Other	309	14.9%
Contusion	234	11.2%
Sprain	144	6.9%
Foreign Body	102	4.9%
Puncture	94	4.5%
Fracture	82	3.9%
Inflammation	77	3.7%
Infection	31	1.5%
Other values (26)	189	9.1%

Length

Max length	59
Median length	9
Mean length	11.71009615
Min length	4

#dependents
Real number (ℝ_≥0)

MISSING

Distinct count	5
Unique (%)	7.8%
Missing	2016
Missing (%)	96.9%
Infinite	0
Infinite (%)	0.0%

Mean	1.953125
Minimum	1.0
Maximum	5.0
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	2
Q3	3
95-th percentile	4
Maximum	5
Range	4
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.075405977
Coefficient of variation (CV)	0.5506078603
Kurtosis	0.4923951058
Mean	1.953125
Median Absolute Deviation (MAD)	1
Skewness	1.044102286
Sum	125
Variance	1.156498016

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	28	1.3%
2	19	0.9%
3	11	0.5%
4	4	0.2%
5	2	0.1%
(Missing)	2016	96.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	28	1.3%
2	19	0.9%
3	11	0.5%
4	4	0.2%
5	2	0.1%

Value	Count	Frequency (%)
5	2	0.1%
4	4	0.2%
3	11	0.5%
2	19	0.9%
1	28	1.3%

osha_injury_type
Categorical

HIGH CORRELATION

Distinct count	6
Unique (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

Injury	2049
Skin disorder	20
All other illnesses	3
Hearing loss	3
Respiratory condition	3

Common Values
Length

Value	Count	Frequency (%)
Injury	2049	98.5%
Skin disorder	20	1.0%
All other illnesses	3	0.1%
Hearing loss	3	0.1%
Respiratory condition	3	0.1%
Poisoning	2	0.1%

Length

Max length	21
Median length	6
Mean length	6.119230769
Min length	6

severity_index
Categorical

MISSING

Distinct count	7
Unique (%)	0.3%
Missing	41
Missing (%)	2.0%
Memory size	16.2 KiB

No Serious Injury Indicated	2026
Back Injury involving Surgery/Extended Disability	7
Fractured Bone(s)	2
Involves AIDS, Herpes, TSS, Cancer, Other Diseases	1
Heart Attack or Cardio-Vascular Accident	1
Other values (2)	2

Common Values
Length

Value	Count	Frequency (%)
No Serious Injury Indicated	2026	97.4%
Back Injury involving Surgery/Extended Disability	7	0.3%
Fractured Bone(s)	2	0.1%
Involves AIDS, Herpes, TSS, Cancer, Other Diseases	1	< 0.1%
Heart Attack or Cardio-Vascular Accident	1	< 0.1%
Serious Burns	1	< 0.1%
Fatality	1	< 0.1%
(Missing)	41	2.0%

Length

Max length	50
Median length	27
Mean length	26.59278846
Min length	3

time_injury
Real number (ℝ_≥0)

ZEROS

Distinct count	252
Unique (%)	12.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	988.2278846153846
Minimum	0
Maximum	2358
Zeros	368
Zeros (%)	17.7%
Memory size	16.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	600
median	1030
Q3	1500
95-th percentile	2000
Maximum	2358
Range	2358
Interquartile range (IQR)	900

Descriptive statistics

Standard deviation	649.793849
Coefficient of variation (CV)	0.65753442
Kurtosis	-0.9322108012
Mean	988.2278846
Median Absolute Deviation (MAD)	470
Skewness	-0.157018299
Sum	2055514
Variance	422232.0462

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	368	17.7%
1100	82	3.9%
1000	79	3.8%
1500	74	3.6%
800	61	2.9%
1400	61	2.9%
1600	53	2.5%
830	47	2.3%
1030	46	2.2%
900	46	2.2%
Other values (242)	1163	55.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	368	17.7%
5	1	< 0.1%
10	5	0.2%
14	1	< 0.1%
15	9	0.4%

Value	Count	Frequency (%)
2358	1	< 0.1%
2345	3	0.1%
2330	3	0.1%
2315	1	< 0.1%
2300	16	0.8%

type_loss
Categorical

HIGH CORRELATION

Distinct count	2
Unique (%)	0.1%
Missing	4
Missing (%)	0.2%
Memory size	16.2 KiB

Specific Injury	2058
Cumulative Trauma	18

Common Values
Length

Value	Count	Frequency (%)
Specific Injury	2058	98.9%
Cumulative Trauma	18	0.9%
(Missing)	4	0.2%

Length

Max length	17
Median length	15
Mean length	14.99423077
Min length	3

policy_yr
Real number (ℝ_≥0)

Distinct count	15
Unique (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2007.5461538461539
Minimum	2000
Maximum	2014
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	2000
5-th percentile	2001
Q1	2004
median	2008
Q3	2011
95-th percentile	2014
Maximum	2014
Range	14
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	4.240234755
Coefficient of variation (CV)	0.00211214808
Kurtosis	-1.207004565
Mean	2007.546154
Median Absolute Deviation (MAD)	4
Skewness	-0.1583360318
Sum	4175696
Variance	17.97959078

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2011	191	9.2%
2013	186	8.9%
2012	163	7.8%
2010	153	7.4%
2005	152	7.3%
2004	150	7.2%
2007	132	6.3%
2008	131	6.3%
2009	129	6.2%
2014	129	6.2%
Other values (5)	564	27.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2000	102	4.9%
2001	101	4.9%
2002	125	6.0%
2003	125	6.0%
2004	150	7.2%

Value	Count	Frequency (%)
2014	129	6.2%
2013	186	8.9%
2012	163	7.8%
2011	191	9.2%
2010	153	7.4%

reforms_dummy
Categorical

MISSING

Distinct count	3
Unique (%)	0.2%
Missing	837
Missing (%)	40.2%
Memory size	16.2 KiB

California Refom 1	661
California Refom 0	434
California Reform 2	148

Common Values
Length

Value	Count	Frequency (%)
California Refom 1	661	31.8%
California Refom 0	434	20.9%
California Reform 2	148	7.1%
(Missing)	837	40.2%

Length

Max length	19
Median length	18
Mean length	12.03509615
Min length	3

length_employed
Real number (ℝ_≥0)

MISSING

Distinct count	25
Unique (%)	1.3%
Missing	109
Missing (%)	5.2%
Infinite	0
Infinite (%)	0.0%

Mean	7.789954337899544
Minimum	1.0
Maximum	49.0
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	4
median	7
Q3	11
95-th percentile	15
Maximum	49
Range	48
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	4.659635565
Coefficient of variation (CV)	0.598159548
Kurtosis	6.129521989
Mean	7.789954338
Median Absolute Deviation (MAD)	4
Skewness	1.086851841
Sum	15354
Variance	21.7122036

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
4	183	8.8%
2	182	8.8%
3	145	7.0%
5	145	7.0%
10	142	6.8%
11	142	6.8%
12	135	6.5%
13	133	6.4%
6	125	6.0%
7	124	6.0%
Other values (15)	515	24.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	96	4.6%
2	182	8.8%
3	145	7.0%
4	183	8.8%
5	145	7.0%

Value	Count	Frequency (%)
49	1	< 0.1%
46	1	< 0.1%
43	1	< 0.1%
33	1	< 0.1%
27	1	< 0.1%

diff_carrier_employer
Real number (ℝ)

ZEROS

Distinct count	92
Unique (%)	4.5%
Missing	13
Missing (%)	0.6%
Infinite	0
Infinite (%)	0.0%

Mean	6.8916303821964195
Minimum	-79.0
Maximum	496.0
Zeros	473
Zeros (%)	22.7%
Memory size	16.2 KiB

Quantile statistics

Minimum	-79
5-th percentile	0
Q1	1
median	2
Q3	5
95-th percentile	26.7
Maximum	496
Range	575
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	23.55366805
Coefficient of variation (CV)	3.417720734
Kurtosis	146.5467193
Mean	6.891630382
Median Absolute Deviation (MAD)	2
Skewness	10.2292231
Sum	14245
Variance	554.7752784

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	474	22.8%
0	473	22.7%
3	206	9.9%
2	195	9.4%
4	135	6.5%
5	116	5.6%
6	84	4.0%
7	58	2.8%
8	33	1.6%
9	25	1.2%
Other values (82)	268	12.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-79	1	< 0.1%
-1	7	0.3%
0	473	22.7%
1	474	22.8%
2	195	9.4%

Value	Count	Frequency (%)
496	1	< 0.1%
345	1	< 0.1%
264	1	< 0.1%
253	1	< 0.1%
252	1	< 0.1%

diff_employer_injury
Real number (ℝ_≥0)

ZEROS

Distinct count	97
Unique (%)	4.7%
Missing	13
Missing (%)	0.6%
Infinite	0
Infinite (%)	0.0%

Mean	15.796323173681664
Minimum	0.0
Maximum	1958.0
Zeros	1506
Zeros (%)	72.4%
Memory size	16.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	19
Maximum	1958
Range	1958
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	117.3032394
Coefficient of variation (CV)	7.425983764
Kurtosis	136.9655436
Mean	15.79632317
Median Absolute Deviation (MAD)	0
Skewness	10.9244156
Sum	32651
Variance	13760.04998

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	1506	72.4%
1	176	8.5%
2	70	3.4%
3	54	2.6%
4	43	2.1%
6	23	1.1%
5	18	0.9%
7	14	0.7%
11	9	0.4%
10	8	0.4%
Other values (87)	146	7.0%
(Missing)	13	0.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1506	72.4%
1	176	8.5%
2	70	3.4%
3	54	2.6%
4	43	2.1%

Value	Count	Frequency (%)
1958	1	< 0.1%
1782	1	< 0.1%
1763	1	< 0.1%
1605	1	< 0.1%
1403	1	< 0.1%

shift
Categorical

Distinct count	3
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	16.2 KiB

2nd	945
1st	854
3rd	281

Common Values
Length

Value	Count	Frequency (%)
2nd	945	45.4%
1st	854	41.1%
3rd	281	13.5%

Length

Max length	3
Median length	3
Mean length	3
Min length	3

length_how_injury
Real number (ℝ_≥0)

Distinct count	41
Unique (%)	2.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	57.67163461538462
Minimum	7
Maximum	60
Zeros	0
Zeros (%)	0.0%
Memory size	16.2 KiB

Quantile statistics

Minimum	7
5-th percentile	45
Q1	59
median	60
Q3	60
95-th percentile	60
Maximum	60
Range	53
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	6.020436833
Coefficient of variation (CV)	0.1043916455
Kurtosis	15.75156812
Mean	57.67163462
Median Absolute Deviation (MAD)	0
Skewness	-3.680373736
Sum	119957
Variance	36.24565966

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
60	1357	65.2%
59	349	16.8%
58	34	1.6%
55	28	1.3%
54	26	1.2%
53	25	1.2%
57	22	1.1%
51	22	1.1%
56	21	1.0%
47	18	0.9%
Other values (31)	178	8.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
7	2	0.1%
17	1	< 0.1%
20	1	< 0.1%
21	1	< 0.1%
22	2	0.1%

Value	Count	Frequency (%)
60	1357	65.2%
59	349	16.8%
58	34	1.6%
57	22	1.1%
56	21	1.0%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	Dependent	ave_wkly_wage	body_part	cause	claimant_age	atty_firm_name	gender	marital_status	claim_st	depart_code	detail_cause	domestic_foreign	employ_status	handling_office	how_injury_occur	injury_city	injury_postal	injury_state	jurisdiction	lost_time_or_medicalonly	nature_injury	#dependents	osha_injury_type	severity_index	time_injury	type_loss	policy_yr	reforms_dummy	length_employed	diff_carrier_employer	diff_employer_injury	shift	length_how_injury
0	NaN	NaN	Wrist	Strain or Injury By	37.0	NaN	Male	NaN	California	NaN	Strain/Injury by Repetitive Motion	Domestic	Unknown/Other	LOS ANGELE	EE CLAIMS: CT 1991 -4/10/01 TO BILATERAL HANDS - WRISTS AND	BURBANK	91502	California	California	Lost Time	Carpal Tunnel Syndrome	NaN	Injury	No Serious Injury Indicated	0	Cumulative Trauma	2001	California Refom 1	15.0	52.0	1403.0	1st	60
1	NaN	465.0	Multiple Lower Extremities	Strain or Injury By	45.0	NaN	Male	NaN	California	NaN	Strain/Injury by Repetitive Motion	Domestic	Full-Time	LOS ANGELE	EE CLAIMS : CT 1990 -04 -01 -03 TO LOW BACK (L) SIDE (L) LEG	BURBANK	91502	California	California	Lost Time	Strain	NaN	Injury	No Serious Injury Indicated	0	Specific Injury	2003	California Refom 1	19.0	8.0	911.0	1st	60
2	NaN	237.0	Knee	Strain or Injury By	38.0	NaN	Male	NaN	California	NaN	Strain/Injury by Repetitive Motion	Domestic	Unknown/Other	LOS ANGELE	EMPLOYEE CLAIMS: CT 12/6/01 - 12/6/02 TO LEFT KNEE FROM REPE	BURBANK	91502	California	California	Lost Time	Strain	NaN	Injury	No Serious Injury Indicated	0	Specific Injury	2002	California Refom 1	13.0	0.0	1258.0	1st	60
3	NaN	1378.0	Multiple Body Parts	Fall, Slip or Trip Injury	NaN	NaN	Male	NaN	California	NaN	Fall/Slip, Different Level	Domestic	Full-Time	LOS ANGELE	WALKING ON PLYWOOD RAMP, RAMP SLIPPED AND HE FELL ON R SIDE.	LAS VEGAS	89101	Nevada	California	Lost Time	Multiple Injury, Physical Only	NaN	Injury	No Serious Injury Indicated	730	Specific Injury	2001	California Refom 0	14.0	1.0	0.0	1st	60
4	NaN	888.0	Multiple Body Parts	Miscellaneous Causes	26.0	NaN	Male	NaN	California	NaN	Misc, Other	Domestic	Full-Time	SACRAMENTO	EE ALLEGES R SCAPULA INJURIES OF UNKNOWN CAUSE	UNKNOWN	91502	California	California	Medical Only	Multiple Injury, Physical Only	NaN	Injury	No Serious Injury Indicated	0	Specific Injury	2001	California Refom 0	14.0	26.0	16.0	1st	46
5	NaN	1300.0	Other Facial Soft Tissue	Struck or Injured By	NaN	NaN	Male	NaN	California	NaN	Struck by Object Lifted/Handled	Domestic	Full-Time	SACRAMENTO	FOLDING A CLOTHING RACK, IT COLLAPSED AND STRUCK EES HEAD	LAKE ARROWHEAD	92352	California	California	Lost Time	Contusion	NaN	Injury	No Serious Injury Indicated	1030	Specific Injury	2001	California Refom 0	15.0	18.0	0.0	2nd	57
6	NaN	NaN	Hand	Caught In, Under or Between	NaN	NaN	Male	NaN	California	NaN	Caught In/Between, Machinery	Domestic	Full-Time	SACRAMENTO	ELECTRIC WORK CART SLAMMED ON MY HAND	VALENCIA	91355	California	California	Medical Only	Crushing	NaN	Injury	No Serious Injury Indicated	1150	Specific Injury	2001	California Refom 0	NaN	68.0	0.0	2nd	37
7	NaN	735.0	Multiple Body Parts	Strain or Injury By	NaN	NaN	Male	NaN	California	NaN	Strain/Injury by Jumping	Domestic	Full-Time	LOS ANGELE	EE JUMPED OFF LADDER, FRACTURED R FOOT AND SPRAINED R ANKLE.	LOS ANGELES	91502	California	California	Lost Time	Fracture	NaN	Injury	No Serious Injury Indicated	1500	Specific Injury	2001	California Refom 0	14.0	0.0	3.0	2nd	60
8	NaN	NaN	Multiple Body Parts	Miscellaneous Causes	18.0	NaN	Male	NaN	California	NaN	Misc, Other	Domestic	Unknown/Other	SACRAMENTO	EE CAME INTO WORK FEELING SINUS PRESSURE & NAUSEA	UNKNOWN	91355	California	California	Medical Only	Multiple Injury, Physical Only	NaN	Injury	No Serious Injury Indicated	0	Specific Injury	2001	California Refom 0	15.0	96.0	0.0	1st	49
9	NaN	1967.0	Chest	Fall, Slip or Trip Injury	NaN	NaN	Male	NaN	California	NaN	Fall/Slip, Misc	Domestic	Unknown/Other	SACRAMENTO	HANDLING FOOD SUBSTANCE, SLIPPED & FELL ON GREENBED AREA	LOS ANGELES	90001	California	California	Medical Only	Multiple Injury, Physical Only	NaN	Injury	No Serious Injury Indicated	1630	Specific Injury	2001	California Refom 0	14.0	6.0	0.0	2nd	56

Last rows

	Dependent	ave_wkly_wage	body_part	cause	claimant_age	atty_firm_name	gender	marital_status	claim_st	depart_code	detail_cause	domestic_foreign	employ_status	handling_office	how_injury_occur	injury_city	injury_postal	injury_state	jurisdiction	lost_time_or_medicalonly	nature_injury	#dependents	osha_injury_type	severity_index	time_injury	type_loss	policy_yr	reforms_dummy	length_employed	diff_carrier_employer	diff_employer_injury	shift	length_how_injury
2070	NaN	NaN	Knee	Fall, Slip or Trip Injury	40.0	NaN	Male	NaN	Georgia	17.0	Fall/Slip, Same Level	Domestic	Unknown/Other	WC SOUTHEA	EE WAS WALKING AND TRIPPED ALONG AND TRIPPED OVER WOOD AND E	FAYETTEVILLE	30214	Georgia	Georgia	Medical Only	Strain	NaN	Injury	No Serious Injury Indicated	1500	Specific Injury	2014	NaN	1.0	2.0	1.0	2nd	60
2071	NaN	NaN	Low Back Area	Strain or Injury By	27.0	NaN	Male	NaN	North Carolina	22.0	Strain/Injury by Lifting	Domestic	Unknown/Other	WC SOUTHEA	EMPLOYEE WAS LIFTING HEAVY OBJECTS AND SWITCHED TO A LIGHTER	WILMINGTON	28411	North Carolina	North Carolina	Medical Only	Strain	NaN	Injury	No Serious Injury Indicated	1300	Specific Injury	2014	NaN	1.0	1.0	0.0	2nd	60
2072	NaN	NaN	Thigh	Burn or Scald - Heat or Cold Exposure	32.0	NaN	Female	NaN	Georgia	21.0	Burn/Exposure, Steam/Fluid	Domestic	Unknown/Other	WC SOUTHEA	CLEANING UP KITCHEN AFTER LUNCH, SPILLED BOILING HOT WATER O	ATLANTA	30336	Georgia	Georgia	Medical Only	Burn	NaN	Injury	No Serious Injury Indicated	0	Specific Injury	2014	NaN	1.0	0.0	0.0	1st	60
2073	NaN	41.0	Ankle	Strain or Injury By	40.0	NaN	Male	NaN	Georgia	17.0	Strain/Injury by Misc	Domestic	Unknown/Other	WC SOUTHEA	EMPLOYEE WAS ROOFING SHINGLES, WHEN HE TWISTED HIS RIGHT ANK	SENOIA	NaN	Georgia	Georgia	Medical Only	Sprain	NaN	Injury	No Serious Injury Indicated	1145	Specific Injury	2014	NaN	1.0	1.0	0.0	2nd	60
2074	NaN	NaN	Low Back Area	Fall, Slip or Trip Injury	50.0	NaN	Male	NaN	Georgia	18.0	Fall/Slip, Same Level	Domestic	Unknown/Other	WC SOUTHEA	EMPLOYEE HAS A POWERED MONITOR ATTACHED TO A CABLE. WHEN THE	ATLANTA	30315	Georgia	Georgia	Medical Only	Strain	NaN	Injury	No Serious Injury Indicated	0	Specific Injury	2014	NaN	1.0	3.0	0.0	1st	60
2075	NaN	NaN	Other Facial Soft Tissue	Fall, Slip or Trip Injury	48.0	NaN	Female	NaN	Georgia	17.0	Fall/Slip, Misc	Domestic	Unknown/Other	WC SOUTHEA	MEDIC WAS CALLED TO THE MILL FOR PAINTER WHO HAD FALLEN. PAT	FAYETTEVILLE	30214	Georgia	Georgia	Medical Only	Contusion	NaN	Injury	No Serious Injury Indicated	945	Specific Injury	2014	NaN	1.0	0.0	0.0	2nd	60
2076	NaN	NaN	Foot	Struck or Injured By	25.0	NaN	Female	NaN	Georgia	14.0	Struck by Object Lifted/Handled	Domestic	Unknown/Other	WC SOUTHEA	WHILE PUSHING CARTS ONE ROLLED OVER HER FOOT. ANDREA FLADER,	WILLIAMSON	30292	Georgia	Georgia	Medical Only	Sprain	NaN	Injury	No Serious Injury Indicated	2130	Specific Injury	2014	NaN	1.0	0.0	1.0	3rd	60
2077	NaN	NaN	Knee	Strain or Injury By	41.0	NaN	Male	NaN	Georgia	17.0	Strain/Injury by Misc	Domestic	Unknown/Other	WC SOUTHEA	EMPLOYEE WAS WALKING ON LOOSE GRAVEL WHEN HE TWISTED HIS RIG	ATLANTA	30316	Georgia	Georgia	Medical Only	Strain	NaN	Injury	No Serious Injury Indicated	1000	Specific Injury	2014	NaN	1.0	0.0	8.0	2nd	60
2078	NaN	NaN	Toe(s)	Struck or Injured By	35.0	NaN	Male	NaN	Maryland	17.0	Struck by Object Lifted/Handled	Domestic	Unknown/Other	WC SOUTHEA	MOVING WALL AND THE WALL CAME DOWN CRUSHING EE TOE. PRODUCTI	COLUMBIA	21046	Maryland	Maryland	Medical Only	Crushing	NaN	Injury	No Serious Injury Indicated	1420	Specific Injury	2014	NaN	1.0	0.0	0.0	2nd	60
2079	NaN	NaN	Knee	Fall, Slip or Trip Injury	47.0	NaN	Male	NaN	Virginia	18.0	Fall/Slip, Same Level	Domestic	Unknown/Other	WC SOUTHEA	EE WAS PUSHING SOUND CART IN WOODS WHEN HE TRIPPED ON A TREE	RICHMOND	23226	Virginia	Virginia	NaN	Sprain	NaN	Injury	No Serious Injury Indicated	1700	Specific Injury	2014	NaN	1.0	3.0	0.0	2nd	60

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows